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(54) REPRODUCER 



(57) The present invention relates to a 

reproduction apparatus for reproducing view data 
including several tracks within a range of a 
reproduction processing capacity. A reproduction 
apparatus (10) for reproducing data from a recording 
medium comprising several tracks each used for 
recording image data and one or more pieces of edit 
data comprises input means (11) for inputting the data 
from the recording medium, analysis means (12) for 
identifying the recording track type of the Input data, 
storage means (13) for storing a priority-level 
assignment table associating the track types with turns 
for decoding process and for storing a predetermined 
threshold value serving as a border between the turns 
for data to be reproduced and the turns for data not to 
be reproduced, a plurality of decode means (15, 16, 17) 
each used for decoding each type of data and priority- 
level determination means (14) for determining whether 
the input data is to be decoded based on a track type 



identified by the analysis means (12) and the priority- 
level assignment table and the threshold value both 
stored in the storage means (13), and for outputting 
the input data to the decode means (15, 16, 17) 
selected by the type of the input data when decoding 
the input data, 
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[0001] The present invention relates to a reproduction apparatus capable of reproducing view data including a 
plurality of tracks in an operation to reproduce the data from the tracks at a track count according to its own 
reproduction processing capacity. 

Background Art 



[0002] In production of a video content, special effects are utilized in order to present a plurality of pieces 
of information, bring about a change to a screen changeover and protect privacy on screens. As editing techniques 
utilizing the special effects, there are a method of recording view data, to which the special effects have been 
applied, onto a recording medium, and a method whereby original view data is recorded as It is on a recording medium 
along with a processing procedure for special effects and, at a reproduction time, the original view data Is 
processed in accordance with the processing procedure for the special effects in order to reproduce the special 
effects. The latter method is specially referred to as a non-destmctive editing process. This editing method can be 
implemented by using application software such as Quick Time, which is referred to hereafter simply as QT. 
[0003] In the non destructive editing process, not only can the special effects be applied to an image, but 
superimposition of characters and graphics can also be described In a QT file format To be more specific, it is 
possible to record onto a recording medium the distinction among special effects, characters and graphics in 
addition to start time, end time and the ID of an image to be added the special effects in the QT file format. Then, 
in a reproduction process, a special effect of a specified type or the like can be applied to a specified image 
before displaying the image at a specified time on a display unit. Thus, the editor is capable of reproducing an 
image exhibiting the same special effect as the one added in the editing process. 

[0004] By the way, in such a non-destructive editing process, information including a large number of special 
effects and characters may be superposed on the original image data in some cases. In such cases, since the 
information such as the numerous special effects must be superposed at the same time on the original image data, the 
limit of a reproduction processing capacity of the reproduction apparatus per unit time may be exceeded. If the 
reproduction apparatus makes an attempt to reproduce all infomnation such as the special effects applied to the 
original image in spite of the fact that the limit of the reproduction processing capacity is exceeded, there will 
be raised a problem such as an uneven reproduced image or a lost frame. 

[0005] It IS thus an object of the present invention addressing the problem described above to provide a 
reproduction apparatus capable of reproducing view data property within the range of the reproduction processing 
capacity of tiie reproduction apparatus by selectively nan-owing display objects down to information such as special 
effects to be superposed at the same time on an original image on a priority basis within the range of the 
reproduction processing capacity. 

Disclosure of Invention 

40 [0006] As described above, since a reproduction apparatus provided by the present invention reproduces tracks in 
view data within the range of tiie reproduction processing capacity, an image can be reproduced in a smootii operation 
without losing a frame. 

Brief Description of Drawings 

45 

[0007] 

Fig. 1 is a block diagram showing the configuration of a reproduction apparatus Implemented by a first embodiment; 
Fig. 2 is a diagram showing typical input data supplied to the first embodiment; 

Fig. 3 shows a flowchart representing operations carried out by the reproduction apparatus implemented by the 
first embodiment; 

Figs. 4A and 48 are diagrams each showing a priority-level assignment table used in the first embodiment; 

Fig. 5 is a block diagram showing the configuration of a reproduction apparatus implemented by a second 
embodiment; 
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Fig. 6 is a diagram showing typical input data supplied to the second embodiment; 
Fig. 7 is a diagram showing a priorrty-ieve! assignment table used In the second embodiment; 
Fig. 8 is a block diagram showing the configuration of a reproduction apparatus implemented by a third embodiment; 
Fig. 9 is a diagram showing a priority-level assignment table used in the third embodiment; 

Fig. 10 shows a flowchart representing operations carried out by a text-data select unit employed in the third 
embodiment; 

Fig- 11 is a block diagram showing the configuration of a reproduction apparatus implemented by a fourth 
embodiment; 

Fig. 1 2 is a diagram showing a priority-level assignment table used in the fourth embodiment; 

Fig. 13 shows a flowchart representing operations carried out by a data select unit employed in the fourth 

embodiment; 

^0 Fig. 1 4 shows a flowchart representing operations carried out by a data select unit employed in a fifth embodiment; 

Fig. 1 5 shows a flowchart representing operations carried out by a data select unit employed in a sixth embodiment; 

Fig. 16 shows a flowchart representing operations carried out by a data select unit employed in a seventh 
25 embodiment; 

Fig. 17 shows a flowchart representing a process to select a track to be reproduced at the start time 
of a reproduction process; and 

Fig. 1 8 shows a flowchart representing a process to calculate a variable Rt. 
Best Mode for Carrying Out the Invention 



35 



[00081 Embodiments of the present invention are explained by referring to the diagrams as follows. It is to be 
noted that, throughout the diagrams, the same configuration elements are denoted by the same reference numeral and 

explained only once. 

(First Embodiment) 

[0009] A first embodiment is an embodiment implementing a reproduction apparatus for reproducing an image by 
selecting a particular one of a variety of graphics, which are provided for an original image, In accordance with 
the reproduction processing capacity of the reproduction apparatus as a particular graphic to be reproduced at the 
same time as the original image. 

[00101 Fig- 1 «s a block diagram showing the configuration of the reproduction apparatus implemented by the 
^ first embodiment 

[0011] The reproduction apparatus 10 implemented by the first embodiment as shown in Fig. 1 comprises an input- 
data interface 11, an input-data analysis unit 12, a priority-level assignment table storage unit 13, a priority-level 
identification unit 14, an image-decoding unit 15, a graphics-decoding unit 16, a sound-decoding unit 17, an Image- 
processing unit 1 8, an image output unit 1 9 and a sound output unit 20. 

[0012] The input-data interface 11 is an interface for connecting the reproduction apparatus 10 to an external 
apparatus and inputting view data from an externa! source. The input view data is supplied to the input-data 
analysis unit 12. Examples of the external apparatus are a drive apparatus for reading out view data from a disk- 
shaped recording medium, a CD drive apparatus for reading out view data from a CD-ROM, a DVD drive apparatus for 
reading out view data from a DVD and a hard-disk drive apparatus. 

[0013] The input-data analysis unit 12 determines the substance of input view data and outputs a result of the 
determination to the priority-level identification unit 14 along with the view data. The result of the determination 
indicates that the Input view data is video data, audio data, title graphics data, frame graphics data, shade 
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graphics data or the like. 

[0014] On the basis of the result of the determination, the priority-level identification unit 14 

determines a reproduction priority level of the input view data in accordance with a predetermined threshold value 
by referring to a priority-level assignment table stored in the priority-level assignment table storage unit 13, in 
accordance with the determined effect of the reproduction priority level, the priority-level identification unit 14 
discards the view data or, alternatively, outputs the view data to the image-decoding unit 15 or the graphics- 
decoding unit 16. If any tow arbitrary tracks are selected from a plurality of tracks and the two tracks cannot be 
reproduced at the same time so that only either of the two tracks can be reproduced, the reproduction pnonty level 
is used to select one of the tracks as a track that should take precedence of the other track. 

[0015] A designer or manufacturer of the reproduction apparatus 1 0 determines the threshold value in advance on 
the basis of the reproduction processing capacity of hardware employed in the reproduction apparatus 10. and sets 
the threshold value in the priority-level Identification unit 14. It is to be noted that the threshold value cari 
also be stored in the priority-level assignment table storage unit 13 to be fetch later by the priorrty-level 
identification unit 1 4 when necessary. 

[0016] The priority-level assignment table storage unit 13 is typically a read-only memory allowing data stored 
therein to be erased. An example of such a memory, which is used as a memory for storing a priority-level assignment 
table to be described later, is an EEPROM (Electrically Erasable Programmable Read-Only Memory). 
[0017] The image-decoding unit 15 decodes the input view data (which is video data) and outputs a result of the 

decoding process to the image-processing unit 1 8. 

[0018] The graphics-decoding unit 16 decodes the input view data (which is graphics data) and outputs a result 
of the decoding process to the image-processing unit 18. 

[0019] The image-processing unit 18 carries out predetermined graphic processing on an original image on the 
basis of Input video data and input graphics data, outputting a result of the graphic processing to the image output 

unit 19. , ^. . 

[0020] The image output unit 19 carries out signal processing corresponding to an external display unit on view 

data before outputting the view data. 
[0021] On the other hand, the sound-decoding unit 17 decodes input sound data (or input audio data) and outputs 
a result of the decoding process to the sound output unit 20. 

[0022] The sound output unit 20 carries out signal processing con^esponding to an external audio reproduction 
30 unit on the sound data before outputting the sound data. 

[0023] Next, the operation of the reproduction apparatus implemented by the first embodiment is explained. 
[0024] Fig. 2 is a diagram showing typical input data supplied to the first embodiment. 

[0025] Fig. 3 shows a flowchart representing operations carried out by the reproduction apparatus Implemented by 
the first embodiment. 

55 [0026] Figs 4A and 4B are diagrams each showing a priority-level assignment table used in the first embodiment. 
The priority-level assignment table shown in Fig. 4A Is referred to hereafter as a first typical pnonty-level 
assignment table and the priority-level assignment table shown in Fig. 4B is refen-ed to hereafter as a second 
typical priority-level assignment table. 

[0027] First of all, input data is supplied to the input-data analysis unit 12 by way of the input-data 
40 interface 11 The input data is view data comprising video data, audio data and a plurality of types of graphics 
data Each data includes an identifier for identifying a track type used for distinguishing the substance of data from the 
substance of other data. The types of graphics data include for example a title, which is a video headline, a frame 
defining edges of a screen, a shade for hiding a portion of a screen beneath a shadow in order to protect privacy or 
for another purpose, a mark such as an arrow attached to a portion of a screen in order to draw attention to the 
portion, an accent added to a portion of a screen to put emphasis on the portion and a notice such as a displayed 
blowoff for stressing a caption or a phrase. 

[0028] Such input data typically has a QT format. QT is software for managing various kinds of data along the 
time base The QT software serves as an extended function of the OS. This function is executed to synchronize data 
such as a moving image, a sound and a text, and display the data without using special hardware. In a QT file, a 
basic data unit is called an atom. QT comprises a resource atom and a data atom. A resource atom is information 
required for reproducing a QT file and information required for referencing actual data. On the other hand, the data 
atom is a portion for storing the actual data such as video and audio data. Each atom includes information on a size 
and information on a type in addition to the data of the atom. In addition, in QT. a smallest unit of data is handled as 
a sample. A chunk is defined as a set of samples. QT is typically disclosed in, among others. Inside Macintosh: 
QuickTime (a Japanese version) (Addison-Wesley). 

[0029] For example, input data comprises a resource atom 101 and a data atom 102 as shown in Fig. 2. The data 
atom 102 comprises various kinds of actual data including video data 121, audio data 122, graphics data (title) 123. 
which Is graphics data of a title, graphics data (frame) 124. which is graphics data of a fi-ame, graphics data 
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(shade) 125, which is graphics data of a shade, graphics data (mark) 126, which is graphics data of a mark, graphics 
data (accent) 127. which is graphics data of an accent and graphics data (notice) 128, which is graphics data of a 
notice Used for managing these pieces of actual data on the time base, the resource atom 101 comprises a track atom 
(video) 111, a track atom (audio) 112, a track atom (title) 113, a track atom (frame) 114, a track atom (shade) 115. 
a track atom (mark) 116, a track atom (accent) 117 and a track atom (notice) 118, In addition, an identifier for 
identifying the track type of actual data is prescribed in a track property atom, which is an atom provided m a 
user data atom within a track atom for actual data as an atom for prescribing attributes of a track. A user data atom 
is a QT atom for prescribing data defined by the user. 

[0030] The input-data analysis unit 12 identifies the track type of actual data by referencing an identifier 
prescribed in this track property atom and outputs a result of the identification to the priority-level identification unit 14. 
[0031] When the priority-level identification unit 14 receives the result of the determination and actual data, 
at a step S11 of the flowchart shown in Fig. 3, the priority-level identification unit 14 makes an access to the 
priority-level assignment table storage unit 13 to acquire a priority level, 

[0032] A priority level is a sequence number assigned to the type of each of graphics to be superposed on an 
original image. Typical assignment of priority levels Is shown in Fig. 4A. As shown in the figure, a priority level 
of 1 is assigned to the title track type, a priority level of 5 is assigned to the frame track type, a pnonty 
level of 2 is assigned to the shade track type, a priority level of 6 is assigned to the mark track type, a pnonty 
level of 4 is assigned to the accent track type and a priority level of 3 is assigned to the notice track type. It 
is to be noted that, the smaller the sequence number representing a priority level, the higher the pnonty level and, 
conversely, the larger the sequence number, the lower the priority level The figure does not show the fact that a 
highest priority level of 1 is assigned to video data 121 and audio data 122. 

[0033] Then, the priority-level identification unit 14 detemriines what type of actual data is the type of the 
input actual data on the basis of the input result of the determination. Subsequently, the priority-level 
identification unit 14 obtains the priority level corresponding to the type of the actual data from a pnonty-level 
assignment table. Then, at the next step S12, the priority-level identification unit 14 compares the pnonty level 
of the actual data with a threshold value. 
[0034] If the result of the comparison indicates that the priority level of the actual data is higher than the 
threshold value, the flow of the operation goes on to a step SI 3 at which the priority-level identification unit 14 
outputs the actual data to the image-decoding unit 15, the graphics-decoding unit 16 or the sound-decoding unit 17 
in dependence on the type of the actual data, if the result of the comparison indicates that the pnonty level of 
the actual data is lower than the threshold value, on the other hand, the actual data is discarded. 

[0035] For example, the threshold value is set at a typical value of 3 according to the simultaneous 

reproduction processing capacity of the reproduction apparatus 10. In this case, video data 121. audio data 122. 
graphics data (title) 123 and graphics data (shade) 125 are supplied to the image-decoding unit 15, the graphics- 
decoding unit 16 or the sound-decoding unit 17. Then, the Image-processing unit 18 carries out a process to 
superpose the graphics data (title) 123 and the graphics data (shade) 125 on the decoded video data 121 to generate 
display data and output the display data to the image output unit 19. 

[0036] As another example, the threshold value is set at a typical value of 5 according to the simultaneous 
reproduction processing capacity of the reproduction apparatus 10. In this case, video data 121. audio data 122. 
graphics data (title) 123, graphics data (shade) 125, graphics data (accent) 127 and graphics data (notice) 128 are 
supplied to the image-decoding unit 15. the graphics-decoding unit 16 or the sound-decoding unit 17. Then, the image- 
processing unit 18 cames out a process to superpose the graphics data (title) 123, the graphics data (shade) 125, 
the graphics data (accent) 127 and the graphics data (notice) 128 on the decoded video data 121 to generate display 
data and output the display data to the image output unit 1 9. 

[0037] As described above, in the first embodiment, actual data is reproduced in a range of the processing 
capacity of the reproduction apparatus 10 in accordance with a priority level. Thus, view data can be reproduced in 
a smooth operation and without losing a frame. In addition, since actual data is reproduced in a range of the 
processing capacity of the reproduction apparatus 10 in accordance with a priority level, it is not necessary to 
produce view data by adjusting the view data to the processing capacity of the reproduction apparatus 10. Thus, view 
data common to reproduction apparatus can be utilized even if the reproduction apparatus have processing capacity 

50 different from each other. In addition, by assigning different priority levels to different types of graphics, it is 
possible to reproduce an image with different graphics superposed thereon even for the same processing capacity. 
[0038] A first priority-level assignment table of Fig. 4A shows that priority levels assigned to graphics data 
are fixed without regard to the number of graphics to be superposed on a display at the same time. Thus, if the actual 
data to be reproduced at the same time is video data 1 21 . audio data 1 22 and graphics data (frame) 1 24 whereas the 

55 threshold value is set at 3, and the reproduction apparatus 10 still has available capacity for processing, then 
since the priority level of the graphics data (frame) 124 is 5. the graphics data (frame) 124 is not output to the 
graphics-decoding unit 16. That is to say. only the video data 121 and the audio data 122 are reproduced. In order 
to solve this problem, it is nice to employ a second priority-level assignment table shown in Fig. 4B as a 
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substitute for the first priority-level assignment table. 

[0039] The second priority-level assignment table shown in Fig. 4B prescribes priority levels assigned to 
graphics to be processed at the same time in accordance with tracks of the graphics. 

[0040] The first row of the second priority-level assignment table shows priority levels assigned to graphics 
5 for a case in which the tracks of the graphics are the frame, the shade, the mark, the accent and the notice, which 
are simultaneously processed. In this case, a priority level of 1 is assigned to the frame track type, a priority 
level of 5 is assigned to the shade track type, a priority level of 2 is assigned to the mark track type, a priority level of 
3 is assigned to the accent track type and a priority level of 4 is assigned to the notice track type. The second 
row of the second priority-level assignment table shows priority levels assigned to graphics for a case in which the 
10 tracks of the graphics are the title, the frame and the shade, which are simultaneously processed. In this case, a 
priority level of 1 is assigned to the title track type, a priority level of 2 is assigned to the frame track type 
and the priority level of 2 is also assigned to the shade track type. Similar assignment of priority levels to track 
frames is applied to the third and subsequent rows of the second priority-level assignment table. Finally, the last 
row of the second priority-level assignment table shows priority levels assigned to graphics for a case in which the 
tracks of the graphics are the mari<. the accent and the notice, which are simultaneously processed. In this case, a 
priority level of 1 is assigned to the mark track type, a priority level of 2 is assigned to the accent track type 
and a priority level of 3 is assigned to the notice track type. 

[0041] In the reproduction apparatus 10 using such a second priority-level assignment table, if the tracks of 
input view data are the video data 121, the audio data 122, the graphics data (frame) 124, the graphics data (shade) 
125, the graphics data (mark) 126, the graphics data (accent) 127 and graphics data (notice) 128, the prionty-level 
identification unit 14 applies the priority levels prescribed in the first row of the second priority-level 
assignment table in execution of the processes at the steps SI 2 and SI 3 shown in Fig. 3. Thus, if the pieces of view 
data to be processed at the same time are the video data 121 , the audio data 122, the graphics data (frame) 124, the 
graphics data (shade) 125. the graphics data (mark) 126. the graphics data (accent) 127 and graphics data (notice) 
128 whereas the threshold value is set at 3, the graphics data (shade) 125. the graphics data (accent) 127 and 
graphics data (notice) 128 are not reproduced. 
[0042] If the tracks of input view data are the video data 121, the audio data 122, the graphics data (title) 
123, the graphics data (frame) 124 and the graphics data (shade) 125, on the other hand, the priority-level 
identification unit 14 applies the priority levels prescribed in the second row of the second priority-level 
assignment table in execution of the processes at the steps S12 and Si 3 shown in Fig. 3. In accordance with the 
second row, the frame and the shade both have a priority level of 2. Thus, if these pieces of graphics data are 
received at the same time, they will be both discarded. 
[0043] Next, another embodiment is explained. 
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(Second Embodiment) 



[0044] In the case of the first embodiment, only graphics data comprises a plurality of tracks. In the case of 
the second embodiment, data comprising a plurality of tracks is not only the graphics data, but audio data, text 
data and other data also comprise a plurality of tracks. 

[0045] Fig. 5 is a block diagram showing the configuration of a reproduction apparatus Implemented by the second 
embodiment. 

[0046] The reproduction apparatus 30 implemented by the second embodiment as shown in Fig. 5 comprises an 
input-data interface 11, an input-data analysis unit 12, a priority-level Identification unit 31. a priority-level 
assignment table storage unit 33, an image-decoding unit 15, a graphics-decoding unit 16, a text-decoding unit 32, a 
sound-decoding unit 1 7, an image-processing unit 1 8, an image output unit 1 9 and a sound output unit 20. 
^ [0047] The input-data interface 11 is connected to the input-data analysis unit 12 and the input-data analysis 
unit 12 is connected to the priority-level identification unit 31 . The priority-level identification unit 31 is connected to the 
priority-level assignment table storage unit 33, the image-decoding unit 15, the graphics-decoding unit 16, the text- 
decoding unit 32 and the sound-decoding unit 17. 

[0048] The image-decoding unit 15, the graphics-decoding unit 16 and the text-decoding unit 32 are connected to 
50 the image-processing unit 18, The text-decoding unit 32 decodes input view data (which is text data) and outputs a 
result of the decoding process to the Image-processing unit 1 8. 

[0049] The image-processing unit 1 8 is connected to the image output unit 1 9 whereas the sound-decoding unit 1 7 
is connected to the sound output unit 20. 

[0050] Next, the operation of the reproduction apparatus implemented by the second embodiment is explained. 
[0051] Fig. 6 is a diagram showing typical input data supplied to the second embodiment. Fig. 7 is a diagram 
showing a priority-level assignment table used in the second embodiment. 

[0052] First of all. input data is supplied to the input-data analysis unit 12 by way of the input-data 
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interface 11 The input data is view data comprising one or more pieces of video data, one or more pieces of audio 
data, one or more pieces of graphics data and one or more pieces of text data. Each of the pieces of data includes 
an identifier indicating the track type of the piece of data. 

[0053] For example, the input data comprises a resource atom 151 and a data atom 152 as shown in Fig. 6. The 
data atom 152 comprises pieces of actual data, which include video-1 data 181, audio-1 data 182. audio-2 data 183, 
audio-3 data 184. graphic-1 data 185, graphic-2 data 186, text-1 data 187. text-2 data 188. text-3 data 189 and text- 
4 data 190. Used for associating these pieces of actual data with each other and managing these pieces of actual 
data on the time base, the resource atom 151 comprises a track atom (video-1) 161, a track atom (audio-1) 162, a 
track atom (audio~2) 163. a track atom (audio-3) 164. a track atom (graphics-1) 165, a track atom {graphics-2) 166, 
a track atom (text-1) 167. a track atom (text-2) 168, a track atom (text-3) 169 and a track atom (text-4) 170. An 
identifier indicating the type of actual data is prescribed in a track property atom in a track atom for the actual data. 
[0054] The input-data analysis unit 12 determines the track type of actual data by referencing an identifier 
prescribed in this track property atom and outputs a result of the determination to the priority-level identification unit 31 . 
[0055] When the priority-level identification unit 31 receives the result of the determination and actual data, 
the priority-level identification unit 31 makes an access to the priority-level assignment table storage unit 33 to 
acquire a priority level. 

[0056] A priority level is a sequence number assigned to each track. Typical assignment of pnonty levels is 
shown in Fig. 7. As shown in the figure, a priority level of 1 is assigned to the track atom (video-1), a priority 
level of 2 is assigned to the track atom (audio-1), a priority level of 5 is assigned to the track atom (audio-2), a 
priority level of 7 is assigned to the track atom (audio-3), a priority level of 6 is assigned to the track atom 
(graphics-1) a priority level of 8 is assigned to the track atom (graphics-2), a priority level of 3 is assigned to 
the track atom (text-1). a priority level of 4 is assigned to the track atom (text>2), a priority level of 9 js 
assigned to the track atom (text-3) and a priority level of 10 is assigned to the track atom (text-4). It is to be 
noted that, the smaller the sequence number representing a priority level, the higher the priority level and. 
conversely, the larger ttie sequence number, the lower the priority level. 

[0057] Then, the priority-level identification unit 31 determines what type of actual data is the type of the 
input actual data on the basis of the input result of the determination. Subsequently, the priority-level 
identification unit 31 obtains the priority level corresponding to the type of the actual data from the pnonty- 
level assignment table. Then, the priority-level identification unit 31 compares the priority level of the actual 
data with a threshold value. 

[0058] If the result of the comparison indicates that the priority level of the actual data is higher than the 
threshold value, the priority-level identification unit 31 outputs the actual data to the Image-decoding unit 15, 
the graphics-decoding unit 16, the text-decoding unit 32 or the sound-decoding unit 17 in dependence on the type of 
the actual data. If the result of the comparison indicates that the priority level of the actual data is lower than 
the threshold value, on the other hand, the actual data is discarded. 

[0059] For example, the threshold value is set at a typical value of 5 according to the simultaneous 

reproduction processing capacity of the reproduction apparatus 30. In this case, video-1 data 181, audio-1 data 182, 
the text-1 data 187 and text-2 data 188 are supplied to the image-decoding unit 15, the sound-decoding unit 17 or the 
text-decoding unit 32. Then, the image-processing unit 18 carries out a process to superpose the text-1 data 187 and 
the text-2 data 188 on the decoded video-1 data 181 to generate display data and output the display data to the 
image output unit 19. 

[0060] As another example, the threshold value is set at a typical value of 7 according to the simultaneous 
reproduction processing capacity of the reproduction apparatus 30. In this case, vldeo-1 data 181. audio-1 data 182. 
audio-2 data 183, graphic-1 data 185, text-1 data 187 and text-2 data 188 are supplied to the image-decoding unit 15, 
the graphics-decoding unit 16, the sound-decoding unit 17 or the text-decoding unit 32. Then, the image-processing 
unit 18 carries out a process to superpose the graphic-1 data 185. the text-1 data 187 and the text-2 data 188 on 
the decoded video-1 data 1 81 to generate display data and output the display data to the image output unit 1 9. 
[0061] As described above, in the second embodiment, actual data is reproduced in a range of the processing 
capacity of the reproduction apparatus 30 in accordance with a priority level. Thus, view data can be reproduced in 
a smooth operation and without losing a frame. In addition, since actual data is reproduced in a range of the 

50 processing capacity of the reproduction apparatus 30 in accordance with a priority level, it is not necessary to 
produce view data by adjusting the view data to the processing capacity of the reproduction apparatus 30. Thus, view 
data common to reproduction apparatus can be utilized even if the reproduction apparatus have processing capacity 
different from each other. In addition, by assigning different priority levels to different types of graphics, it is 
possible to reproduce an image with different graphics superposed thereon even for the same processing capacity. 

55 [0062] Furthermore, by providing a plurality of pieces of audio data, it is possible to keep up with monaural 
reproduction and stereo reproduction. On the top of that, by providing a plurality of pieces of text data, a caption 
can be displayed In a plurality of languages. 
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[0063] Next, another embodiment is explained. 

(Third Embodiment) 

[0064] In the second embodiment using the second priority-level assignment table, the priority-level 

identification unit 31 selects a threshold value in accordance with types of data and compares the priority level 
assigned to a Mack with the threshold value. The priority-level identification unit 31 then determines whether data of 
the tracl< is to be output to decoding units or discarded in dependence on the result of the comparison. In the case 
of a third embodiment, priority-level determination means is provided for every type of data and the priority level 
assigned to input data is identified for each type of data. 

[0065] Fig. 8 is a block diagram showing the configuration of a reproduction apparatus implemented by the third 

embodiment. 

[0066] The reproduction apparatus 40 implemented by the third embodiment as shown in Fig. 8 compnses an input- 
data interface 11 . an input-data analysis unit 41 , a priority-level assignment table storage unit 35, an image-data 
storage unit 42. a graphics-data storage unit 44, a text-data storage unit 46, a sound-data storage unit 48. an 
image-data select unit 43, a graphics-data select unit 45, a text-data select unit 47. a sound-data select unit 49, 
an image-decoding unit 15, a graphics-decoding unit 16. a text-decoding unit 32. a sound-decoding unit 17, an image- 
processing unit 1 8, an image output unit 1 9 and a sound output unit 20. 
[0067] The input-data interface 1 1 is connected to the input-data analysis unit 41 . 

[0068] The Input-data analysis unit 41 is connected to the image-data storage unit 42, the graphics-data storage 
unit 44 the text-data storage unit 46 and the sound-data storage unit 48. The input-data analysis unit 41 supplies 
input d'ata to the image-data storage unit 42, the graphics-data storage unit 44, the text-data storage unit 46 or 
the sound-data storage unit 48 in dependence on the type of the input data. 

[0069] Connected to the image-data select unit 43. the image-data storage unit 42 is a memory for stonng video 
input data Connected to the graphics-data select unit 45. the graphics-data storage unit 44 Is a memory for stonng 
graphics input data. Connected to the text-data select unit 47, the text-data storage unit 46 is a memory for 
storing text input data. Connected to the sound-data select unit 49. the sound-data storage unit 48 is a memory for 
storing audio input data. h,- 
[0070] Connected to the priority-level assignment table storage unit 35 and the image-decoding unit 15, the 
imaqe-data select unit 43 searches a priority-level assignment table stored in the priority-level assignment table 
storage unit 35 for a priority level assigned to a type indicated by a result of the determination as a reproduction 
priority level of input view data, and determines the effect of the priority level by using a threshold value determined 
in advance. The image-data select unit 43 either discards the image data or supplies the image data to the image- 
decoding unit 15 in accordance with a result of the comparison. 

[0071] Connected to the priority-level assignment table storage unit 35 and the graphics-decoding unit 16. the 
graphics-data select unit 45 searches the priority-level assignment table stored in the priority-level assignment 
table storage unit 35 for a priority level assigned to a type indicated by a result of the determination as a 
reproduction priority level of input view data, and determines the effect of the priority level by using a threshold 
value determined in advance. The graphics-data select unit 45 either discards the graphics data or supplies the 
graphics data to the graphics-decoding unit 1 6 in accordance with a result of the comparison. 

[00721 Connected to the priority-level assignment table storage unit 35 and the text-decoding unit 32. the text- 
data select unit 47 searches the priority-level assignment table stored in the priority-level assignment table 
storage unit 35 for a priority level assigned to a type indicated by a result of the detemiination as a reproduction 
priority level of input view data, and determines the effect of the priority level by using a threshold value detemiined 
in advance. The text-data select unit 47 either discards the text data or supplies the te>a data to the text- 

^ decoding unit 32 in accordance with a result of the comparison. 

[0073] Connected to the priority-level assignment table storage unit 35 and the sound-decoding unit 17. the 
sound-data select unit 49 searches the priority-level assignment table stored in the priority-level assignment table 
storage unit 35 for a priority level assigned to a type indicated by a result of the determination as a reproduction 
priority level of input view data, and determines the effect of the priority level by using a threshold value 

50 determined in advance. The sound-data select unit 49 either discards the sound data or supplies the sound data to 
the sound-decoding unit 17 in accordance with a result of the comparison. 

[0074] The image-decoding unit 15, the graphics-decoding unit 16 and the text-decoding unit 32 are connected to 
the image-processing unit 18. which is connected to the image output unit 19. The sound-decoding unit 17 is 
connected to the sound output unit 20. 
55 [00751 A typical priority-level assignment table like one shown in Fig. 9 is stored in the priority-level assignment 
table storage unit 35. As shown in the figure, a threshold value is assigned to each data type whereas a pnority 
level Is assigned to each data sub-type. 
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[0076] Fig. 9 is a diagram showing a priority-level assignment table employed in the third embodiment- 
[0077] In the priority-level assignment table shown in Fig. 9 as a priority-level assignment table for the third 
embodiment, a threshold value is assigned to each data type whereas a priority level is assigned to each track of 
every data type. 

[0078] For example, in the priority-level assignment table, a threshold value of 2 is assigned to the video data 
type and a priority level of 1 Is assigned to the video-1 track. A threshold value of 3 is assigned to the audio 
data type whereas a priority level of 1 is assigned to the audio-1 track type, a priority level of 4 is assigned to 
the audlo-2 track type, a priority level of 3 is assigned to the audlo-3 track type and a pnority level of 2 is 
assigned to the audio-4 track type. A threshold value of 3 is assigned to the graphics data type whereas a pnonty 
level of 1 is assigned to the graphics-1 track type, a priority level of 4 is assigned to the graphics-2 track type 
and a priority level of 2 is assigned to the graphic-3 track type. A threshold value of 2 is assigned to the text data type 
whereas a priority level of 1 Is assigned to the text-1 track type, a priority level of 3 is assigned to the text-2 
track type, a priority level of 5 is assigned to the text-3 track type and a priority level of 6 is assigned to the 
text-4 track type. 

[0079] Next, the operation of the reproduction apparatus implemented by the third embodiment is explained. 
[0080] Fig. 10 shows a flowchart representing operations carried out by a text-data select unit employed In the 
third embodiment. 

[0081] First of all. input data is supplied to the input-data analysis unit 41 by way of the input-data interface 1 1 
[0082] The input-data analysis unit 41 determines the type of input actual data by referring to an identifier 
prescribed in a track property atom and supplies the input data along with the result of the determination to the 
image-data storage unit 42, the graphics-data storage unit 44. the text-data storage unit 46 or the sound-data 
storage unit 48 in dependence on the result of the determination. . 

[0083] The image-data select unit 43. the graphics-data select unrt 45, the text-data select unit 47 and the 
sound-data select unit 49 are different from each other in the types of data handled. Since the image-data select unit 
43 the graphics-data select unit 45, the text-data select unit 47 and the sound-data select unit 49 carry out the 
same processing, however, only the operation of the text-data select unit 47 is explained below as their representative. 
[0084] When a result of the determination and actual data are supplied from the text-data storage unit 46, the 
operation represented by the flowchart shown in Fig. 10 begins with a step S31, at which the text-data select unit 
47 makes an access to the priority-level assignment table storage unit 35 to acquire the track count of the 
reproducible text (the threshold value of the text data stored In the text-data storage unit 46). 

[0085] Then, at the next step S32, the text-data select unit 47 makes an access to the priority-level assignment 
table storage unit 35 to acquire the priority level of the text data. 

[0086] Subsequently, at the next step S33, the text-data select unit 47 refers to the acquired threshold value 
and the acquired priority level to compare the threshold value and the priority level. 

[0087] If a result of the comparison indicates that the priority level of the actual data of the text is higher than the 
threshold value, the flow of the operation goes on to a step 834 at which the actual data of the text Is output to 
the text-decoding unit 32. If a result of the comparison indicates that the priority level of the actual data of the 
text is lower than the threshold value, on the other hand, the actual data of the text is discarded. 

[0088] As described above, in the third embodiment, since the number of reproducible tracks is prescribed for 
each data type, each data can be reproduced property in the range of the reproduction processing capacity of the 
reproduction apparatus. In particular, since the amount of data to be processed in a unit time varies from data type 
to data type, a threshold value appropriate for each data type can be determined. 
[0089] Next, another embodiment Is explained. 

4S (Fourth Embodiment) 

[0090] In the embodiment described above, if tracks of all the data types do not all exist, the reproduction 
processing capacity of the reproduction apparatus is not fully utilized. In order to solve this problem, a fourth 
embodiment Is provided as an embodiment in which each data is reproduced in accordance with the pnonty level of 
the data so that the amount of unutilized remaining reproduction processing capacity is reduced to minimum. 
[0091] Fig. 11 is a block diagram showing the configuration of a reproduction apparatus Implemented by the 
fourth embodiment 

[0092] The reproduction apparatus 50 implemented by the fourth embodiment as shown in Fig. 11 comprises an 
input-data interface 11, an input-data analysis unit 41, an image-data storage unit 42, a graphics-data storage unit 
44 a text-data storage unit 46, a sound-data storage unit 48, a data select unit 51. a priority-level assignment 
table storage unit 37, an image-decoding unit 15, a graphics-decoding unit 16, a text-decoding unit 32, a sound- 
decoding unit 17, an image-processing unit 18, an image output unit 19 and a sound output unit 20. 
[0093] The input-data interface 11 is connected to the input-data analysis unit 41. The input-data analysis unit 
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41 is connected to the image-data storage unit 42, the graphics-data storage unit 44, the text-data storage unit 46 
and the sound-data storage unit 48. 

[0094] The image-data storage unit 42, the graphics-data storage unit 44, the text-data storage unit 46 and the 

sound-data storage unit 48 are connected to the data select unit 51 . 

5 [0095] As will be described later, the data select unit 51 supplies actual data to the image-decoding unit 15, the 
graphics-decoding unit 16, the text-decoding unit 32 or the sound-decoding unit 17 or. alternatively, discards the 
actual data in dependence on the reproduction processing capacity of the reproduction apparatus 50, the priority 
level of the actual data and the existence/non-existence of the priority level. If necessary, the data select unit 
51 fetches a maximum reproduction processing capacity (MaxTrack) and the priority level of the actual data from the 

10 priority-level assignment table storage unit 37. 

[0096] For the reason described above, the priority-level assignment table storage unit 37 is used as a memory 
for storing a priority-level assignment table showing priority levels assigned to all tracks without regard to the 
types of the tracks. 

[0097] Fig. 1 2 is a diagram showing a typical priority-level assignment table used in the fourth embodiment. 
15 [0098] As is obvious from the typical priority-level assignment table shown in Fig. 12, a priority level of 1 is 
assigned to the video-1 track type, a priority level of 9 Is assigned to the video-2 track type, a priority level of 
6 is assigned to the audio-1 track type, a priority level of 2 is assigned to the audio-2 track type, a priority level of 1 1 
is assigned to the audio-3 track type, a priority level of 12 is assigned to the audio-4 track type, a priority 
level of 4 Is assigned to the graphics-1 track type, a priority level of 10 is assigned to the graphic-2 track type, 
a priority level of 5 is assigned to the graphics-3 track type, a priority level of 15 is assigned to the graphics-4 
track type, a priority level of 17 is assigned to the graphics-5 track type, a priority level of 3 is assigned to 
the text-1 track type, a priority level of 7 is assigned to the text-2 track type, a priority level of 8 Is assigned 
to the text-3 track type, a priority level of 13 is assigned to the text-4 track type, a priority level of 14 is 
assigned to the text-5 track type and a priority level of 16 is assigned to the text-6 track type. It is to be noted 
that, the smaller the number representing a priority level, the higher the priority level and, conversely, the 
larger the number, the lower the priority level. 

[0099] The image-decoding unit 15, the graphics-decoding unit 16 and the text-decoding unit 32 are connected to 
the image-processing unit 18. The image-processing unit 18 is connected to the image output unit 19. The sound- 
decoding unit 17 is connected to the sound output unit 20. 

[0100] Next, the operation of the reproduction apparatus implemented by the fourth embodiment is explained. 
[0101] Fig. 13 shows a flowchart representing operations carried out by the reproduction apparatus implemented 
by the fourth embodiment. 

[0102] First of all, input data is supplied to the input-data analysis unit 41 by way of the input-data interface 1 1 . 
[0103] The input-data analysis unit 41 determines the type of input actual data by referring to an Identifier 
prescribed In a track property atom and supplies the input data along with the result of the determination to the 
image-data storage unit 42. the graphics-data storage unit 44, the text-data storage unit 46 or the sound-data 
storage unit 48 in dependence on the result of the determination. 

[0104] The flowchart shown in Fig. 13 begins with a step S41 at which the data select unit 51 makes an access to 
the priority-level assignment table storage unit 37 to acquire MaxTrack of the reproduction apparatus 50. 
[0105] Then, at the next step S42, the data select unit 51 makes an access to the priority-level assignment 
table storage unit 37 to identify a video-data track having the highest priority level and fetches the video data for 
the track from the image-data storage unit 42. 

[0106] Subsequently, at the next step S43. the data select unit 51 subtracts a part of reproduction processing 
capacity, which has been already allocated to the video data, from MaxTrack. 
45 [0107] Then, at the next step S44, the data select unit 51 makes an access to the priority-level assignment 
table storage unit 37 to identify an audio-data track having the highest priority level and fetches the audio data 
for the track from the sound-data storage unit 48. 

[0108] Subsequently, at the next step S45, the data select unit 51 subtracts a part of reproduction processing 
capacity, which has already been allocated to the audio data, from MaxTrack. 
50 [0109] In this way, a smallest amount of the capacity to reproduce an image can be preserved. This is because 
the reproduction processing capacity has been allocated to the video data and the audio data, which take precedence 
of others. 

[0110] Then, at the next step S46, the data select unit 51 determines whether or not the relation MaxTrack > 0 
holds true, that is, whether or not a reproduction processing capacity is left in the reproduction apparatus 50. 
55 [0111] If the result of the determination indicates that the relation MaxTrack > 0 holds true, that is, reproduction 
processing capacity is still available in the reproduction apparatus 50. the flow of the operation goes on to a step 
S47 at which the data select unit 51 makes an access to the priority-level assignment table storage unit 37 to 
select the track of actual data having the highest priority level among tracks stored in the storage units as tracks 
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with no reproduction processing capacity allocated thereto yet. 

[0112] Subsequently, at the next step S48, the data select unit 51 allocates a part of the reproduction 
processing capacity to the selected actual data and subtracts the allocated part of the reproduction processing 

capacity from MaxTrack. 

5 [0113] If the result of the determination indicates that the relation MaxTrack ^ 0 holds true, that is, no 
reproduction processing capacity Is left in the reproduction apparatus 50, on the other hand, the operation to 

select a track to be reproduced is ended. 

[0114] As described above, the fourth embodiment sequentially selects a data track having the highest priority 
level among tracks stored in the storage units as tracks with no reproduction processing capacity allocated thereto 
10 yet as long as the reproduction processing capacity is still left. Thus, the reproduction processing capacity of the 
reproduction apparatus 50 can all be utilized with no portion of the reproduction processing capacity left unused. 
[01 1 5] Next, another embodiment is explained. 
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(Fifth Embodiment) 

[0116] In the fourth embodiment, there Is a point of view at which the data select unit is made capable of 
determining a reproducible track with ease. From this point of view, the reproduction processing capacity displayed 
by the reproduction apparatus as reproduction processing capacity required for processing data of tracks are 
regarded as a capacity uniform for all the tracks. For this reason, a reproducible track is detemnined only on the 
basis of a track count. In the case of a fifth embodiment, on the other hand, a reproducible track is determined by 
considering time it takes to carry out a process to reproduce the track. Thus, the fifth embodiment is capable of 
utilizing the reproduction processing capacity of the reproduction apparatus with an even higher degree of 
efficiency than the fourth embodiment 

[0117] Thus, the reproduction apparatus Implemented by the fifth embodiment is provided with a priority- 
level assignment table storage unit 37, which has not only a non-volatile storage circuit for storing a priority- 
level assignment table, but also a writable storage circuit for storing different pieces of data required in 
processing and a timer connected to the data select unit 51 as a timer-displaying means shown in none of the 
figures. An example of the writable storage circuit is a RAM (Random-Access Memory). The data select unit 51 is a 
component for carrying out a process represented by a flowchart shown in Fig. 14. OthenA/ise, since the data select 
unit 51 has the same configuration as the one shown in Fig. 11, the configuration of the data select unit 51 is not 
explained. 

[0118] In addition, a uniform unit time of the reproduction processing is assumed for this embodiment In the 

case of QT, an example of the unit time is the product of a time scale and a sample duration. 

[01 1 9] Next, the operation of the reproduction apparatus implemented by the fifth embodiment is explained. 

[0120] Fig. 14 shows a flowchart representing operations carried out by a data select unit employed in the fifth 

embodiment. 

[0121] First of all, input data is supplied to the input-data analysis unit 41 by way of the input-data interface 1 1 . The 
input-data analysis unit 41 determines the type of input actual data by referring to an Identifier prescribed in a 
track property atom and supplies the input data along with the result of the determination to the Image-data storage 
unit 42, the graphics-data storage unit 44, the text-data storage unit 46 or the sound-data storage unit 48 in 
dependence on the result of the determination. 

[0122] The flowchart shown in Fig. 14 begins with a step S51 at which the data select unit 51 initializes 
variables such as T1 , T2, Tr, Tc and Ts. 

[0123] Then, at the next step S52. the data select unit 51 obtains the current time from the timer and sets the 
cun-ent time in the variable T1 . 

[0124] Subsequently, at the next step S53, the data select unit 51 acquires a frame rate of video data (image 
data) as a result of the calculation from a time-to-sample atom and a media handler atom. 

[0125] Then, at the next step S54, the data select unit 51 calculates a processing time allocated to a process 
to reproduce one frame, subtracts a compensation time Tc from the processing time and sets the result of the 
subtraction in the variable Tr. The compensation time Tc Is time it takes to cany out a process including an operation 
to select a track. Thus, the variable Tr is an effective time allocated to a process to reproduce one frame. 
[0126] The compensation time Tc is stored in the priority-level assignment table storage unit 37 as an initial 
value detemiined in advance. Thereafter, the Initial value is changed to a time actually required during the 
operation of the reproduction apparatus. The predetermined initial value is typically found as follows. A plurality 
of pieces of input data is prepared. The pieces of Input data each include a track count The number of pieces of 
input data is set at such a value that a process always needs to be carried out to select one of the tracks. In 
addition, it takes long time to identify and select a track having a high priority level. Then, the pieces of Input 
data are each supplied to the reproduction apparatus, and the time it takes to Identify and select a track having a 
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high priority level is measured for each piece of input data. Finally, the longest time selected among the measured 
times is taken as a processing time. 

[0127] Then, at the next step S55, the data select unit 51 makes an access to the priority-level assignment 
table storage unit 37 to identify a video-data track having the highest priority level and fetches the video data for 
the track from the image-data storage unit 42. 

[0128] Subsequently, at the next step S56, the data select unit 51 calculates a consumption time It takes to 
carry out a process to reproduce this fetched video data and sets the time in the variable Ts. The time it takes to 
carry out the reproduction process varies in dependence on the codec type of the data. For this reason, data is 
supplied to the reproduction apparatus, a process to reproduce the data is carried out and the processing time is 
measured for each codec type. Then, a statistical processing time such as an average processing time is determined 
from measured processing times. It is to be noted that the codec type Is the type of a method for encoding and 
decoding data. In the case of video data, an example of the codec type is the MPEG2 method, 

[0129] Then, at the next step S57, the data select unit 51 subtracts the variable Ts from the variable Tr and 
takes a difference obtained as a result of the subtraction as a new value of the variable Tr . 

[0130] Subsequently, at the next step S58, the data select unit 51 adds the track of the video data fetched at 
the step S55 to a reproduction list. The reproduction list is a table stored in the priority-level assignment table storage 
unit 37 as a table of track IDs. 

[0131] Then, at the next step S59, the data select unit 51 makes an access to the priority-level assignment 
table storage unit 37 to identify an audio-data track having the highest priority level and fetches the audio data 

20 for the track from the sound-data storage unit 48. 

[0132] Subsequently, at the next step S60. the data select unit 51 calculates a consumption time it takes to 
carry out a process to reproduce this fetched audio data and sets the time in the variable Ts. Then, the data select 
unit 51 subtracte the variable Ts from the variable Tr and takes a difference obtained as a result of the 
subtraction as a new value of the variable Tr. Subsequently, the data select unit 51 adds the track of the audio 

25 data fetched at the step S59 to the reproduction list 

[0133] in this way, a smallest amount of the reproduction capacity to reproduce an image can be preserved. This 
is because the reproduction processing capacity has been allocated to the video data and the audio data, which take 
precedence of others. 

[0134] Then, at the next step S61, tiie data select unit 51 determines whether or not the relation Tr > 0 holds 
ti-ue, that is, whether or not a reproduction processing capacity is still available in the reproduction apparatus. 
[0135] ' If the result of the determination indicates that the relation Tr > 0 holds true, that Is, tiie 
reproduction processing capacity is still left in the reproduction apparatus, the flow of the operation goes on to a 
step S62. At this step, the data select unit 51 makes an access to the priority-level assignment table storage unit 
37 to select a data track having the highest priority level among tracks stored in the storage units as ti-acks, the 
properness of the reproduction process of which has not been determined. 

[0136] Subsequentiy, at the next step S63, the data select unit 51 calculates a consumption time it takes to carry 
out a process to reproduce data of the selected frame and sets the time in the variable Ts. 

[0137] Then, the data select unit 51 compares the variable Tr witii the variable Ts. If the variable Tr is found 
greater than the variable Ts. tiie flow of the operation goes on to a step S65 at which the data select unit 51 adds 
the data track selected at the step S62 to the reproduction list. This is because data of the selected track can be 
reproduced within the range of the remaining reproduction processing capacity. 

[0138] Then, at the next step S66, the data select unit 51 subtracts tiie variable Ts from the variable Tr and 
takes a difference obtained as a result of tiie subti-action as a new value of the variable Tr. Subsequentiy, the flow 
of the operation goes back to the step S61 . 

[0139] If the determination result obtained at the step S61 indicates that tiie relation Tr ^ 0 holds true, that is. 
tine reproduction processing capacity is no longer available in the reproduction apparatus or if the detemrtlnation 
result obtained at the step S64 indicates that the relation Tr ^ Ts holds true, on the other hand, the flow of tiie 
operation goes on to a step S67 at which the data select unit 51 acquires the current time from the timer and sete 
the current time in the variable T2. 
50 [0140] Then, at tiie next step S68. the data select unit 51 subtracts the variable T1 from tiie variable T2 and 
sets a difference obtained as a result of the subtraction in the compensation time Tc. In this way. the compensation 
time Tc is changed to the time actually required by the reproduction apparatus. 

[0141] Subsequently, the data select unit 51 outputs data to be reproduced in accordance with the reproduction 
list to the image-decoding unit 15. the graphics-decoding unit 16. ttie text-decoding unit 32 or the sound-decoding 
55 unit 1 7 in dependence on the substance of the data. As a result, the reproduction apparatus reproduces view data. 

[0142] As described above, In the fifth embodiment, by considering time it takes to actually carry out a process 
to reproduce a track, a data track having the highest priority level is sequentially selected among tracks stored in 
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the storage units as tracks with no reproduction processing capacity allocated thereto yet. Thus, the reproduction 
processing capacity of the reproduction apparatus can all be even better utilized with no portion of the 
reproduction processing capacity left unused than the fourth embodiment. 
[01 431 Next, another embodiment is explained. 

5 

(Sixth Embodiment) 

[0144] In the case of the fifth embodiment, if the reproduction processing capacity is still available in the 
reproduction apparatus, each track is examined in an order starting with a track having the highest priority level 
fo in order to determine whether or not the examined track can be reproduced within the range of the available capacity 
for the reproduction processing. If the track cannot be reproduced within the available capacity for the 
reproduction processing, the operation to examine tracks is ended without determining whether or not any of the 
other tracks can be reproduced within such a range. In the case of a sixth embodiment, on the other hand, even if a 
track is determined to be irreprbducible within the available capacity for the reproduction processing, the 
operation to examine remaining tracks is continued by determining whether or not the next track can be reproduced 
within such a range. Thus, the sixth embodiment is capable of utilizing the reproduction processing capacity of the 
reproduction apparatus with a higher degree of efficiency than the fifth embodiment 

[0145] The reproduction apparatus implemented by the sixth embodiment is also provided with a priority-level 
assignment table storage unit 37, which has not only a non-volatile storage circuit for storing a priority-level 
assignment table, but also a writable storage circuit for storing different pieces of data required in processing 
and a timer connected to the data select unit 51 as a timer-displaying means shown in none of the figures. An 
example of the writable storage circuit is a RAM (Random-Access Memory). In order to utilize the reproduction 
processing capacity more efficiently, however, the data select unit 51 is designed as a component for carrying out a 
process represented by a flowchart shown in Fig. 15. Otherwise, since the reproduction apparatus has the same 
configuration as the one shown in Fig. 1 1 , the configuration of the reproduction apparatus is not explained. 
[0146] Fig. 15 shows a flowchart representing operations carried out by a data select unit employed in the sixth 
embodiment. 

[0147] In the operations represented by the flowchart shown in Fig. 15, input data is supplied by way of the 
input-data interface 1 1 . Operations carried out by the data select unit 51 at steps S51 to S60 to select a video- 
data track and an audio-data track having the highest priority level and add the selected tracks to the reproduction 
list are the same as their counterparts of the flowchart shown in Fig. 14. It is thus unnecessary to repeat the 
explanation of those steps. 

[0148] Then, at the next step S61, the data select unit 51 determines whetiier or not the relation Tr > 0 holds 
true. If the result of the determination Indicates that the relation Tr > 0 holds true, that is, the reproduction 
processing capacity is still available in the reproduction apparatus, the flow of the operation goes on to a step 
S62. At this step, the data select unit 51 makes an access to the priority-level assignment table storage unit 37 to 
select a data track having the highest priority level among tracks stored in the storage units as tracks, the properness 
of the reproduction process of which has not been determined yet. 

[0149] Subsequently, at the next step S63, the data select unit 51 calculates the time it takes to carry out a 

process to reproduce data of the selected frame and sets the time in the variable Ts. 

[0150] Then, the data select unit 51 compares the variable Tr with the variable Ts. If the variable Tr is 
greater than the variable Ts, the flow of the operation goes on to a step S65 at which the data select unit 51 adds 
the data track selected at the step S62 to the reproduction list. This is because data of the selected track can be 
reproduced within the range of the remaining reproduction processing capacity. 

[0151] Then, at the next step S66. the data select unit 51 subtracts the variable Ts from the variable Tr and 
takes a difference obtained as a result of the subtraction as a new value of the variable Tr. Subsequently, the flow 
of the operation goes back to the step S61 . 

[0152] If the determination result obtained at the step S61 indicates that the relation Tr ^ 0 holds true, that is. 
the reproduction processing capacity is no longer available in the reproduction apparatus, on tiie otiier hand, the 
flow of the operation goes on to a step S67 at which the data select unit 51 acquires tiie current time from the timer 
and sets the current time in the variable T2. 

[0153] Then, at the next step S68, the data select unit 51 subtracts the variable T1 from tiie variable T2 and 
sets a difference obtained as a result of the subtraction in the compensation time Tc. In this way. ttie compensation 
time Tc is changed to the time actually required by the reproduction apparatus. 

[0154] In addition, if the determination result obtained at the step S64 indicates that the relation Tr ^ Ts holds true, 
the data select unit 51 makes an access to tiie priority-level assignment table storage unit 37 to determine whether 
or not tracks still exist in the storage units as tracks, the properness of tiie reproduction process of which has 
not been determined yet. The data select unit 51 determines tiie existence of such tracks in order to detemnine 
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whether or not a data track reproducible within the range of the remaining reproduction processing capacity exists 
among tracks other than the selected data track. This is because the reproduction processing capacity is no longer 
available as the capacity large enough for carrying out a process to reproduce the selected data track. 
[0155] If the result of the determination confirms the existence of a track, the propemess of the reproduction 

5 process of which has not been determined yet, the flow of the operation goes back to the step S61 . If the result of 
the determination confirms the non-existence of a track, the propemess of the reproduction process of which has not 
been determined yet, on the other hand, the operations of the steps S67 and S68 are carried out, 
[0156] As described above, in the sixth embodiment, the storage units are searched for all tracks reproducible 
within the range of the remaining reproduction processing capacity by taking priority levels into consideration as 

10 long as the reproduction processing capacity remains. Thus, the reproduction processing capacity of the reproduction 
apparatus can all be even better utilized with no portion of the reproduction processing capacity left unused than 
the fifth embodiment. 

[0157] Next, another embodiment Is explained. 
75 (Seventh Embodiment) 

[0158] As preconditions of the fifth and sixth embodiments, the reproduction processing and the unit time are 
uniform for all tracks. In the case of a seventh embodiment, however, these preconditions are not required. Thus, 
the seventh embodiment is a more general embodiment. 

[0159] Fig. 16 shows a flowchart representing operations carried out by a data select unit employed in the 

seventh embodiment. 

[0160] First of all, input data is supplied to the input-data analysis unit 41 by way of the input-data interface 1 1 . 
[0161] The Input-data analysis unit 41 determines the type of input actual data by referring to an identifier 
prescribed in a track property atom and supplies the input data along with the result of the determination to the 
image-data storage unit 42, the graphics-data storage unit 44, the text-data storage unit 46 or the sound-data 
storage unit 48 in dependence on the result of the determination. 
[0162] The flowchart shown in Fig. 16 begins with a step S81 at which the data select unit 51 initializes 
variables such as T1 , T2, Rt, Rc. Rp. Tc and Tf . 

[0163] Then, at the next step S82, the data select unit 51 acquires a frame rate of video data (image data) as a 
30 result of the calculation from a time-to-sample atom and a media handler atom. 

[0164] Subsequently, at the next step S83, the data select unit 51 calculates a processing time allocated to a 
process to reproduce one frame and sets the result of the calculation in the variable Tf. The variable Tf represents 
the time it takes to reproduce one frame. 

[0165] Then, at the next step 884. the data select unit 51 divides a compensation time Tc by the variable Tf and 
35 sets a result of the division in the variable Rc. The compensation time Tc is the time It takes to carry out 

processing such as a process to select a track. 

[0166] Subsequently, at the next step S85, the data select unit 51 rearranges tracks In an order of priority 
levels typically in accordance with a priority-level assignment table. 

[0167] Then, at the next step S86, tiie data select unit 51 selects a track to be reproduced at the start time of 
40 the reproduction processing as a track reproducible within the range of tiie reproduction processing capacity. 

[0168] The following description explains a process to select a track to be reproduced at the start time of tiie 
reproduction processing. 

[0169] Fig. 17 shows a flowchart representing the process to select a track to be reproduced at the start time 

of the reproduction processing. 

45 [0170] The flowchart shown in Fig. 17 begins with a step S1 11 at which the data select unit 51 substitutes tiie 
variable Rc to the variable Rt representing a total processing amount of the reproduction processing. 
[0171] Then, at the next step S112, the data select unit 51 makes an access to the priority-level assignment 
table storage unit 37 to identify a video-data track having the highest priority level and fetches the video data 
for the track from the image-data storage unit 42. 

50 [0172] Subsequentiy, at the next step S1 13, the data select unit 51 calculates an amount of reproduction 
processing required to reproduce the video data fetched from the image-data storage unit 42 and sets the result of 
the calculation in the variable Rs, In the case of QT, tfie amount of reproduction processing required to reproduce 
video data is typically a quotient obtained as a result of dividing ttie processing time of 1 sample (one frame) by 
the duration time of the sample. 

55 [0173] It is to be noted that, by the same token, the amount of reproduction processing required to reproduce 
audio data is a quotient obtained as a result of dividing the processing time of 1 sample by the duration time of 
tiie sample. Likewise, the amount of reproduction processing required to reproduce graphics data is a quotient 
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obtained as a result of dividing the processing time of 1 sample (one frame) by 1 video frame time, which is equal 
to the duration time of 1 sample of video data. Similarly, the amount of a special effect is a quotient obtained as a 
result of dividing the processing time of a process to reproduce 1 video frame by the time of the video frame. 
[0174] Then, at the next step S114, the data select unit 51 adds the value of the variable Rs to the variable Rt 
5 and takes the sum obtained as a result of the addition as a new value of the variable Rt 

[0175] Subsequently, at the next step S115, the data select unit 51 makes an access to the priority-level 
assignment table storage unit 37 to identify an audio-data track having the highest priority level and fetches the 
audio data for the track from the Image-data storage unit 42. 

[0175] Subsequently, at the next step S116, the data select unit 51 calculates an amount of reproduction 
10 processing required to reproduce the audio data fetched from the image-data storage unit 42 and sets the result of 
the calculation in the variable Rs. 

[0177] Then, at the next step S117, the data select unit 51 adds the value of the variable Rs to the variable Rt 
and takes the sum obtained as a result of the addition as a new value of the variable Rt. 

[0178] Subsequently, at the next step S118, the data select unit 51 examines the value of the variable Rt to 
15 determine whether or not the variable Rt is not greater than 1.0, that is, whether or not the reproduction 
processing capacity is still available in the reproduction apparatus. 

[0179] If the result of the determination indicates that the relation Rt ^ 0.1 holds true, that is, the variable Rt is 
not greater than 1.0 implying that the reproduction processing capacity is still available in the reproduction 
apparatus, the flow of the process goes on to a step S119 at which the data select unit 51 makes an access to the 
20 priority-level assignment table storage unit 37 to determine whether or not tracks still exist In the storage units 
as tracks, the properness of the reproduction process of which has not been determined yet. 

[0180] Subsequently, at the next step SI 20, the data select unit 51 calculates an amount of reproduction 
processing required to reproduce the selected frame and sets the result of the calculation in the variable Rs. 
[0181] Then, at the next step S121. the data select unit 51 adds the value of the variable Rs to the variable Rt 
25 and takes the sum obtained as a result of the addition as a new value of the variable Rt. Subsequently, the flow of 
the process goes back to the step 81 21 . 

[0182] If the detennination result obtained at the step S1 18 indicates that the relation Rt > 0.1 holds true, 
that is, the variable Rt is greater than 1.0 implying that no reproduction processing capacity is available in the 
reproduction apparatus, on the other hand, the flow of the process goes on to a step SI 22 at which processing 

30 control is returned to a step S87 of the main routine represented by the flowchart shown in Fig. 1 6. 

[0183] Refer back to Fig. 16. At the step S87, the data select unit 51 supplies each piece of data selected as 
data to be reproduced at the start time of the reproduction processing to the image-decoding unit 1 5, the graphics- 
decoding unit 16, the text-decoding unit 32 or the sound-decoding unit 17 in dependence on the substance of the data, 
and the reproduction apparatus starts the video reproduction processing. 

35 [0184] Then, at the next step S88, the data select unit 51 determines whether or not a track, the reproduction 
processing of which has been ended, exists, if the result of the determination indicates that a track, the 
reproduction processing of which has been ended, does not exist, the flow of the operation goes back to the step S88 
at which the data select unit 51 repeats the determination at this step. If the result of the determination indicates that a 
track, the reproduction processing of which has been ended, exists, on the other hand, the flow of the operation 

40 goes on to the step S89 at which the data select unit 51 obtains ttie current time from the timer and sets the 
current time in the variable T1 . 

[0185] Subsequently, at the next step S90. the data select unit 51 deletes the track, the reproduction 
processing of which has been ended, from the reproduction list 

[0186] Then, at the next step S91, the data select unit 51 recalculates the variable Rt The calculation of the 
45 variable Rt is explained as follows. 

[0187] Fig. 1 8 shows a flowchart representing a process to calculate the variable Rt 

[0188] The flowchart shown in Fig. 18 begins with a step SI 31 at which the data select unit 51 substitutes the 
value of the variable Rc to the variable Rt. 

[0189] Then, at the next step S132, the data select unit 51 makes an access to the priority-level assignment 
50 table storage unit 37 to find the number of tracks cataloged on the reproduction list and sete the number of tracks 
in a variable n. 

[0190] Subsequently, at the next step SI 33, the data select unit 51 initializes a loop variable j by setting the 
variable j at 0. 

[0191] Then, the data select unit 51 compares the variable j with the variable n and. if the variable j is found 
55 smaller than the variable n, the flow of the process goes on to a step SI 35 at which the data select unit 51 
calculates the amount of processing for the }th track cataloged on the reproduction list and sets the amount of 
processing in the variable Rs. 
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[01921 Subsequently, at the next step S136. the data select unit 51 adds the value of the variable Rs to the 
variable Rt and takes the sum obtained as a result of the addition as a new value of the variable Rt. 
[0193] Then at the next step S137, the data select unit 51 Increments the loop variable j by 1 and takes the 
result of the increment as a new value of the loop variable j. Subsequently, the flow of the process goes back to 
the step SI 34. In this way. the total amount of processing for the jth track cataloged on the reproduction list is 
recalculated 

[0194] If the comparison result obtained at the step SI 34 Indicates that the variable j is at least equal to the 
variable n on the other hand, the flow of the process goes on to a step S138 at which the control of processing is 
returned to a step S91 of a main routine of the flowchart shown in Fig. 16. This is because the amount of processing 
has been calculated for each track remaining on the reproduction list after the deletion of the track, the 
reproduction processing of which has been ended, that is. because the total amount of processing has been 
recalculated 

[0195] Since extra processing capacity of the reproduction apparatus is generated by the amount of processing 
for the track, the reproduction processing of which has been ended, operations are carried out at steps S92 to S100 
to search for tracks, which can be processed and reproducible by the capacity, as tracks to be reproduced. 
[0196] To put in detail, at the step S92 shown in Fig. 16, the data select unit 51 makes an access to the 
priority-level assignment table storage unit 37 to select a data track having the highest priority level among 
tracks stored in frie storage units but not cataloged yet on the reproduction list. 

[0197] Then, at the next step S93, the data select unit 51 calculates the amount of processing required to carry 
out a process to reproduce the data for the selected track and sets the result of the calculation in the variable Rp. 
[0198] Subsequently, at the next step S94. the data select unit 51 compares the sum obtained as a result of 
adding the value of the variable Rp to the variable Rt with 1 .0 to determine whether or not the sum is smaller than 1 ,0. 
[0199] If the result of the determination indicates that the sum of the variables Rt and Rp is not greater than 
1.0, that is, the relation (Rt + Rp) ^ 1.0 holds true, indicating that the data of the selected track can be reproduced, 
25 the' flow of the operation goes on to a step S95 at which the selected track is added to the reproduction list. Then, 
at the next step S96 the data select unit 51 adds the value of the variable Rp to the variable Rt and takes the sum 
obtained as a result of the addition as a new value of the variable Rt. Subsequently, the flow of the operation goes 
back to the step S92. . 
[0200] If the determination result obtained at the step S94 indicates that the sum of the vanables Rt and Rp is 
greater than 1.0, that is, the relation (Rt + Rp) > 1.0 holds true, indicating that the data of the selected track 
cannot be reproduced by using the remaining reproduction processing capacity, on the other hand, the flow of the 
operation goes on to a step S97 to give up the process to reproduce the data of the selected track, and the data 
select unit 51 obtains the current time from the timer, setting the current time in the variable T2. 

[0201] Then at the next step S98, the data select unit 51 subtracts the variable T1 from the variable T2 and sets 
a difference obtained as a result of the subtraction in the compensation time Tc. In this way, the compensation Tc 

is changed to a period of time actually required by the reproduction apparatus. 

[0202] Subsequently, at the next step S84, the data select unit 51 divides the compensation time Tc by the 
variable Tf and sets a result of the division in the variable Rc, 

[0203] Then at the next step SI 00, the data select unit 51 makes an access to the priority-level assignment 
table storage unit 37 to find the priority level of each of tracks cataloged on the reproduction list as tracks to 
be reproduced and supplies the data of the tracks to the image-decoding unit 15, the graphics-decoding unit 16, the 
text-decoding unit 32 or the sound-decoding unit 17 in accordance with the substance of the data so as to allow the 
reproduction apparatus to start a reproduction process. Then, the data select unit 51 returns control of processing 
to the step S88. x w 

[0204] As described above, in the seventh embodiment, by considering the actual amount of processing for each 
track a data track having the highest priority level is sequentially selected among tracks stored in the storage 
units' as tracks with no reproduction processing capacity allocated thereto yet every time available capacity exists 
for the reproduction processing even if the unit time of the reproduction processing is not uniform for all the 
tracks As a result, the seventh embodiment is capable of better utilizing the reproduction processing capacity of 
the reproduction apparatus with no portion of the reproduction processing capacity left unused than the fourth 
embodiment. 
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Industrial Applicability 

[0205] In a reproduction apparatus provided by the present invention, priority-level determination means finds 
the priority level of input data from a priority-level assignment table and the input data is supplied to 
predetermined decoding means only if the priority level of the Input data is found higher than a threshold value. 
Thus by setting a predetermined threshold value In accordance with the reproduction processing capacity of the 
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reproduction apparatus, the data can be reproduced within a range of the reproduction processing capacity. As a 
result an Image can be obtained in a smooth operation without losing a frame. In addition, input data can be 
supplied to the decoding means on the basis of a reproduction table created as a list of pieces of data to be reproduced 
in the order of priority levels assigned to the pieces of data by utilizing the reproduction processing capacity. 
The priority levels are obtained from the priority-level assignment table showing the priority level of each input 
data whereas the reproduction processing capacity is defined as the amount of processing by which data can be 
reproduced within a predetermined period of time. Thus, since the reproduction apparatus is capable of reproducing 
data within a range of the reproduction processing capacity, an image can be obtained in a smooth operation without 
losing any frames. As a result, data can be reproduced in accordance with a priority level within a range of the 
reproduction processing capacity so that it is possible to exhibit a special effect deemed to be important by 
editors and other users. 



Claims 

1. A reproduction apparatus for reproducing view data including image data and one or more pieces of edit data for 
15 editing said image data, said reproduction apparatus comprising: 

input means for inputting said view data; 

analysis means for identifying the substance of said view data input by said input means; 

storage means for storing a priority-level assignment table showing turns assigned to pieces of data as 
turns to be decoded in accordance with substances of said pieces of data and for storing a predetermined 
threshold value serving as a border between said turns assigned to some of said pieces of data to be 
reproduced and said turns assigned to said remaining pieces of data not to be reproduced; 

a plurality of decode means each provided for each type of data and each used for decoding data of said type; 
and 

detennination means for determining whether or not data input by said input means is to be decoded on the 
basis of a substance identified by said analysis means as a substance of said data, said pnonty-level 
assignment table and said threshold value both stored in said storage means, and for outputting said data to 
one of said decode means, which is selected in accordance with the type of said data, if said data is 
determined to be data to be decoded. 

35 2 A reproduction apparatus for reproducing data from a recording medium comprising a plurality of tracks each used 
for recording image data and one or more pieces of edit data for editing said image data, said reproduction 
apparatus comprising: 



input means for inputting said data from said recording medium; 

analysis means for identifying the type of said track for recording data input by said input means; 



storage means for storing a priority-level assignment table associating types of said tracks with turns 
assigned to pieces of data as turns to be decoded and for storing a predetermined threshold value serving as 
45 a border between said turns assigned to some of said pieces of data to be reproduced and said turns assigned 

to said remaining pieces of data not to be reproduced; 

a plurality of decode means each provided for each type of data and each used for decoding data of said type; 
and 



detennination means for determining whether or not data input by said input means is to be decoded on the 
basis of a type identified by said analysis means as the type of said track and said priority-level 
assignment table and said threshold value stored both in said storage means, and for outputting said data to 
one of said decode means, which is selected in accordance with the type of said data, if said data is 
determined to be data to be decoded. 

A reproduction apparatus for reproducing view data including image data and one or more pieces of edit data for 
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editing said image data, said reproduction apparatus comprising: 

input means for inputting said view data; 

analysis means for identifying the substance of said view data input by said input means; 

storage means for storing a priority-level assignment table showing turns assigned to pieces of data as 
turns to be decoded in accordance with substances of said pieces of data and a fist showing information on 
pieces of data to be reproduced; 

a plurality of decode means each provided for each type of data and each used for decoding data of said type; 
and 

determination means for creating said list on the basis of a substance identified by said analysis means as a 
substance of data input by said input means, said priority-level assignment table stored in said storage 
means and an amount of processing executable for reproducing said data within a predetermined period of 
time, and for outputting said data to one of said decode means, which is selected in accordance with the 
type of said data, if said data Is determined to be data to be decoded on the basis of said created list 



4. A reproduction apparatus according to claim 1 wherein said priority-level assignment table is created for the 
substance of each data to be processed within a predetermined unit time. 

5. A reproduction apparatus according to claim 2 wherein said priority-level assignment table Is created for the 
type of each track to be processed within a predetermined unit time. 

25 

6. A reproduction apparatus according to claim 1 or 2 wherein said priority-level assignment table is created for 
the type of each data and said predetermined threshold value is provided for the type of each data. 
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AUD 1 0-4 


12 


GRAPH 1 CS-1 


4 


GRAPH ICS-2 


10 


GRAPH 1 CS-3 


5 


GRAPHICS-4 


15 


GRAPH I CS-5 


17 


TEXT-1 


3 


TEXT-2 


7 


TEXT-3 


8 


TEXT-4 


13 


TEXT-5 


14 


TEXT-6 


16 
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( START ) 



MAXIMUM REPRODUCTION PROCESSING CAPACITY 
REPRODUCIBLE-TRACK COUNT 



SELECT VIDEO DATA HAVING HIGHEST 
PRIORITY LEVEL 



MAXIMUM REPRODUCTION PROCESSING CAPACITY f 
MAXIMUM REPRODUCTION PROCESSING CAPACITY-1 



SELECT AUDIO DATA HAVING HIGHEST 
PRIORITY LEVEL 



MAXIMUM REPRODUCTION PROCESSING CAPACITY <- 
MAXIMUM REPRODUCTION PROCESSING CAPACITY-1 



S46 



MAXIMUM REPRODUCTION 
PROCESSING CAPACITY > 0? 



'S41 



-S42 



'S43 



'S44 



-S45 





[YES 




SELECT DATA HAVING HIGHEST 
PRIORITY LEVEL 


S47 








MAX 1 MUM 
MAXIMUM 


REPRODUCTION PROCESSING CAPACITY <- 
REPRODUCTION PROCESSING CAPACITY-1 


-'S48 












\ 


"^c-- — ' 



( END ) 
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( START ) 



INITIALIZE VARIABLE S T1.T2,Tr.Tc AND Ts 



T1 <«- CaJRREHT TIME 



ACQUIRE FRAME RATE OF 1 MA6E DATA 

3: 



}^S52 
'S53 



i Tr ^ (TIME ALLOCATED TO 1 FRAME) - To | — S54 

\ SELECT 1MA6E TR ACK HAVING HIGHEST PRIORITY LEVEL { "^SSS 
Ts ^ CONSUMPTION TIME OF SELECTED IMAGE TRACK ^ -556 



[ 



Tr Tr - Ts 

T 



I ADD SELECTED IMAGE TRACK TO REPRODUCTION LIST 



SELECT SOUND TRACK HAVING HIGHEST PRIORITY LEVEL 



Ts <r- CONSUMPTION TIME OF SELECTED SOUND TRACK 
^D^ELECTED^SOUND TRACK TO REPRODUCTION LIST 



S57 
'S58 
-S59 

-S60 




SELECT TRACK HAVING HIGHEST PRIORITY LEVEL 
AMONG REMAINING TRACKS 



T. 



i Ts <r- CONSUMPTICT^TIME (F SELECTED TRACK 



362 
'S63 




ADD SELECTED TRACK TO REPRODUCTION LIST { 



CURRENT TIME 



Tr «- Tr - Ts 



-S66 



Tc <- T2 - T1 



C END ) S68 
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( START 3 
T 



INITIALIZE VARIABLES T1, T2. Tr, To. AND Ts 



T1 



CURRENT TIME 



ACfflJlRE FRAME RATE OF IMAGE DATA 

31 ^ 



Tr <- (TIME ALLOCATED TO 1 FRAME) - To 



SELECT IMAGE TRACK HAVING HIGHEST PRIORITY LEVEL 
* 



Ts -e- CONSUMPTION TIME OF SELECTED IMAGE TRACK 



'S52 
'S53 
'S54 
'S55 
'S56 



Tr <- Tr - Ts 



]^S57 



[ 



ADD SELECTED I MAGE TRACK TO REPRODUCTION LIST 



S58 



SELECT SOUND TRACK HAVH«S HIGHEST PRIORITY LEVEL'~h ^^^Q 



Ts *- CONSUMPTION TIME OF SELECTED SCMJND TRACK 
ADD*SELECTED*SOUND TRACK TO REPRODUCTION LIST 



860 




SELECT TRACK HAVING HIGHEST PRIORITY LEVEL 
AMONG REMAINING TRACKS 



Ts <- CONSUMPTION TIME OF SaECTED TRACK 



-S62 

-S63 



S65 
S66 




YES 



ADD SELECTED TRACK 
TO REPRODlffiTION LIST 



'S67 



Tr Tr - Ts 



3 



To <- T2 - T1 K S68 
( END ) 
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C START ^ 




1 INITIALIZE VARIABLES T1,T2,Rt.Rc.Rp, To AND Tf [^SSl 


•— 1 


— S82 


1 ACOUiRE FRAME RATE OF IMAGE DATA 


1 . — T -~— ~ 

* : 1 


->-S83 


Tf <- TIME ALLOCATED TO 1 FRAME 


' ^ 




Re <- To/Tf 


--^S84 




--S85 


REARRANGE TRACKS IN PRIORITY-LEVEL ORDER 






SELECT TRACK TO BE REPRODUCED AT 
REPRODUCTION START TIME 


—S86 


' * 


--S87 


START REPRODUCTION 






NO — ANY TRACK 
« lUi-cT: WITH ITS REPRODUCTION J> 



COMPLETED? 




T1 <- CURREN T TIME 



DELETE FINISHED TRACK FROM REPRODUCTION LIST 



RECALGUUTE Rt 



}-S89 

-^890 
-S91 



5. 



SELECT TRACK HAVING HIGHEST PRIORITY LEVEL 
AMONG REMAINING TRACKS 



Rp <- PROCESSING AMOUNT OF SELECTED TRACK 



'S92 
'S93 




1. 



T2 



S95- 
S96 



ADD SELECTED TRACK 
TO REPRODUCTIWI LIST 



Rt 



CURRENT TIME —597 

}-S98 
"-S99 



To <- T2 - T1 



Tc/Tf 



Rt 



Rt + Rp 



START REPRODUCTION 
OF NEWLY SELECTED 
TRACK 



-SI 00 
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START 



Rt <r- RC 



SELECT IMAGE TRACK HAVING HIGHEST PRIORITY LEVEL 



I 



SELECT SOUND TRACK HAVING HIGHEST PRIORITY LEVEL 



S118 




SELECT TRACK HAVING HIGHEST PRIORITY 
LEVEL AMONG REMAINING TRACKS 

I 



SI 



-SI 



Rs <- PROCESSING AMOUNT O F SELECTED IMAGE TRACK | ->^S1 
Rt Rt + Rs p-^S1 



-SI 



Rs <- PROCESSING AMOUNT OF SELECTED SOUND TRACK [ -^81 

i i 

Rt Rt + Rs p--S1 



2 
3 
4 
5 
6 
7 



SI 22 

} 



RETURN 



Rs <r- PROCESS ING AMOUNT OF SELECTED TRACK | -^S120 

--8121 



I 



Rt Rt + Rs 
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START } 



Rt <- Rc 



I 



] — ^8131 



I n NUMBER OF TRACKS CATALOGED ON REPRODUCTION LIST "[ -^8132 



LOOP VARIABLE ; J 



8133 



-8134 




NO 



Rs <- PROCESSING AMOUNT OF Jth TRACK ON 
REPRODUCTION LIST 



8138 

I 



RETURN 



Rt 



Rt + Rs 



j -e- j + 1 



-8136 
]]-^S137 
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